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1,0  PURPOSE 

The  activities  legislatively  mandated  under  EPSDT  comprise  a 
comprehensive  health  care  strategy  for  eligible  pediatric  popula- 
tions.   Implementation  of  the  program  across  the  states  has  been 
slow  and  uneven.    Recently,  both  Federal  and  legal  pressures  have 
served  to  stimulate  large  scale  efforts  in  program  implementation. 

Until  now,  the  major  concern  at  both  Federal  and  State/local  levels 
has  been  compliance.    The  central  issue  is:    Have  State  and  local 
efforts  been  in  compliance  with  legislatively  mandated  activities? 
Continued  preoccupation  with  compliance  will  not  serve  to  improve 
EPSDT  efforts.    It  is  time  to  begin  consideration  of  the  issues 
of  EPSDT    impact    (EPSDT  effects  on  the  target  population)  and 
efficiency/effectiveness  (delivery' of  screening,  diagnosis  and 
treatment, services  to  reach  the  maximum  children  in  need  at  least 
cost  and  effort) . 

EPSDT  impact  is  a  primary  Federal  concern  since  the  definition  of 
basic  program  requirements  is  a  Federal  responsibility.  Efficiency 
and  effectiveness  issues  relate  to  State  policy  perogatives.  However, 
determination  of  both  impact  and  efficiency/effectiveness  is 
dependent  upon  State  and  local  efforts  and  information  which 
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describes  the  extent  of  State  and  local  efforts.    The  problem  of 
evaluation  is  compounded  by  a  myriad  of  problems,  the  major  one 
being  the  State  option  permitted  under  Title  XIX  legislation. 
This  has  resulted  in  a  wide  variation  of  EPSDT  program  requirements, 
benefits,  and  data  systems.    This  variation  militates  against  the 
use  of  an  evaluation  system  which  requires  the  collection  of  uni- 
form data. 

In  response  to  the  problems  of  evaluating  EPSDT,  Bokonon  Systems 
has  offered  a  solution.    While  the  States  have  indicated  wide 
variation  in  their  EPSDT  activities,  one  requirement  remains; 
regardless  of  the  structure  of  State  EPSDT  implementation,  early 
and  periodic  screening  diagnosis  and  treatment  must  be  delivered 
to  eligible  populations  in  each  state.    Consequently,  there  should 
be  substantial  commonality  among  states  with  respect  to  what  they 
are  doing,  offsetting  the  weighty  differences  that  exist.  Bokonon 
Systems  has,  therefore,  proposed  to  develop  a  data  classification 
system  to  evaluate  the  wide  range  of  EPSDT  activities.    By  classi- 
fication system  we  mean  the  ordering  of  data  describing  similar 
events  into  categories  by  functional  activities. 

Such  a  system  is  based  on  the  determination  of  data  various  States 
are  presently  collecting  and  the  organization  of  these  data  through 
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analytical  packages  into  a  common  output  necessary  for  Federal 
requirements. 

to  demonstrate  the  validity  of  this  approach,  Bokonon  Systems 
reviewed  EPSDT  efforts  within  eight  States  and  demonstrated 
that  the  quality  of  data  being  collected  while  varying  greatly  was 
of  the  order  necessary  for  a  classification  system.    The  emphasis 
on  program  implementation,  however,  and  the  concern  with  compliance 

have  not  permitted  State  and  local  project  administrators  to  begin 
to  deal  with  the  problems  of  evaluation.    Consequently,  Bokonon 
Systems  has  prepared  this  effort  to  aid  in  the  articulation  of  the 
issues  at  the  State  and  local  level. 

The  paper  categorizies  State  and  local  program  concerns  into  those 
of  compliance  and  planning.    It  identifies  compliance  issues  as  those 
necessary  to  determine  the  extent  (activity  counts)  to  which  EPSDT 
has  been  implemented.    Planning  concerns  are  then  defined  in  terms 
of  the  basic  evaluation  issues  of  the  State  and  local  project 
administrators.    The  issues  stem  from  the  need  to  increase  the 
efficiency  and  effectiveness  of  EPSDT  activities.    Efficiency  in 
this  case  is  defined  as  methods  for  reducing  costs  and  increasing 
quality.    Effectiveness  is  defined  as  methods  for  relating  effi- 
cient operations  to  client  needs  to  increase  the  delivery  of  ser- 
vices to  eligible  pediatric  populations. 
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The  issues  are  considered  in  terms  of  an  EPSDT  delivery  framework 

consisting  of  penetration,  screening,  diagnosis  and  treatment. 

Issues  listed  under  categories  indicate  concerns  for  the  following 

problem  areas: 

Penetration 

Eligibi li ty 
Outreach 

Equivalent  Services 

Screening 

Test  Packages 
Conditions 
Quality  Control 

Diagnosis  and  Treatment 
Provider  Participation 
Quality  of  Care 
Treatment  Maintenance 


This  paper  has  been  prepared  for  presentation  to  a  representative 
group  of  state  and  local  persons  who  are  concerned  with  the  delivery 
of  EPSDT  services.    It  is  expected  that  their  review  of  this 
paper  will  aid  in  refinement  of  the  issues  which  will  then  allow 

for  determination  of  those  service  behaviors  that  need  to  be  measured 
in  order  to  make  decisions  which  can  lead  to  improved  service 
delivery.    Concurrently,    SRS  policy  concerns  will  be  examined 
and  the  relationship  between  Federal  State/local  evaluation 
needs  determined. 
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Finally,  a  classification  system  which  defines  data  by  types  and 
demonstrates  the  relationship  between  their  collecti  on --and  use 
at  local  levels  as  well  as  their  ability  to  meet  Federal  policy 
requirements  will  be  developed. 


i 
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2.0  BACKGROUND 


The  goal  of  Federal  health  programs  for  the  poor  and  medically 
needy  has  been  to  improve  health  status.    In  an  attempt  to  achieve 
this  goal  efforts  have  been  undertaken  through  two  basic 
strategies:  categorical  service  programs  and  financing 
programs.    The  service  programs  (Title  V;  314(e))  provide  direct 
services  which  increase  the  availability  of  health  care  for 
specific  target  populations.    The  financing  programs  (i.e., 
Title  XVIII  and  XIX)  function  to  eliminate  the  financial  barriers 
which  prevent  the  poor  from  utilizing  health  services. 

EPSDT  is  unique  in  that  while  legislative  history  suggests  that 
it  was  originally  conceived  as  an  extension  or  expansion  of 
Title  V  (i.e.,  a  service  program),  it  was  finally  mandated  under 
Title  XIX  (i.e.,  a  financing  program).    The  underlying  rationale 
for  EPSDT  is  that  early  detection  and  treatment  can  decrease  the 
potential  for  long  term  chronic  illness  and  improve  health  status. 
Providing  comprehensive  health  services  through  Title  XIX 
financing  is  difficult  since  Medicaid  vendors  primarily  operate 
within  the  tradition  of  episodic  treatment  and  consequently 
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have  neither  the  inclination  nor  the  capabilities  to  provide 
comprehensive  health  care.    Title  V  programs  which  do  provide 
comprehensive  care  can  offer  only  limited  access  because  they 
■are  neither  large  enough  nor  distributed  geographically 
so  as  to  provide  health  services  to  the  eligible  pediatric 
popul ation . 

The  ambiguity  that  results  from  utilizing  a  financing  program  to 
provide  comprehensive  health  services  is  further  compounded  by 
the  State  options  in  Title  XIX  which  permit  States  to  determine 
the  extent  of  their  participation.    The  result  is  that  EPSDT 
programs  are  packages  of  benefits  and  restrictions  tailored  to 
the  structure  and  objectives  of  individual  States. 

Implementation  of  EPSDT  has  been  slow  and  uneven.    The  hesitancy 
in  implementing  EPSDT  has  been  a  function  of  numerous  problems. 
These  include  ambiguity  in  the  legislation,  the  lack  of  Federal 
guidelines,  and  the  attitudes  of  the  State  administrators  who 
ware  fearful  that  EPSDT  represented  a  massive  increase  in  health 
care  costs  and  provider  availability. 

In  1972  a  strong  Federal  thrust  for  EPSDT  program  implementation 
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was  initiated.    Concurrently,  many  States  were  sued  and 
faced  judgments  requiring  "full"  and  "rapid"  implementation 
of  EPSDT.    The  late  start  coupled  with  the  dual  pressures 
of  Federal  compliance  and  legal  requirements  appear  to  have 
resulted  in  the  bulk  of  States'  efforts  being  directed  to 
locating  and  funnel ing  children  through  screeninq  to  the 
detriment  of  an  organized  comprehensive  EPSDT  effort. 

The  fragmentary  nature  of  EPSDT  efforts  to  date  seems  to  be 
substantiated  by  the  extent  of  available  information  from  which 
to  describe  and  evaluate  State  efforts.    The  information 
available  is  unreliable  and  inconsistent,  which  serves  to 
frustrate  planning,  policy  making  and  coordination  among  the 
numerous  agencies  involved  in  EPSDT  at  all  levels  of  responsibility 
and  operations. 


The  problems  of  obtaining  information  which  yields  an  accurate 
picture  of  EPSDT  across  the  States  is  compounded  by  the  wide 
variation  which  occurs  under  Title  XIX.    Since  the  States  have 
the  option  to  define  eligibility  and  benefits,  it  can  be 
clearly  assumed  that  management  and  information  structures 
evidence  a  similar  variation. 


B0K0N0N 


-9- 


The  wide  range  of  data  systems  which  has  been  identified 
constitutes  a  difficult  problem  for  planning  and  policy  making 
at  the  Federal  level  because  it  makes  comparison  between  State 
programs  difficult,  if  not  impossible.    Clearly,  the  use  of  a 
traditional  evaluation  methodology  which  requires  uniform  data 
specification  and  collection  is  inappropriate.    Implementation  of 
such  a  system  would  place  an  unnecessary  burden  upon  the  States 
in  terms  of  costs  and  time. 

Parenthetically,  it  should  be  noted  that  in  the  history  of  Federal 
evaluation  programs  which  have  required  the  collection  of  uniform 
data,  evaluation  results  have  been  poor  and  usually  inappropriate. 
While  this  is  the  result  of  many  factors,  the  most  important  is 
the  fact  that  uniformly  imposed  information  and  evaluation  systems 
typically  neglect  the  needs  of  the  local  administrator  who  is  the 
responsible  agent  for  data  collection.    Since  he  does  not  under- 
stand data  collection  requirements  in  terms  of  his  own  project's 
self-interest,  he  directs  limited  attention  to  such  efforts. 

Consequently,  evaluation  systems  are  frequently  produced  which 
lose  their  meaning  as  programmatic  tools  and  become  independent 
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functions  unrelated  to  the  project  activities.    These  efforts 

usually  have  low  priority  at  the  local  level  and  data  obtained 

are  typically  fragmented,  frequently  inaccurate  and  usually  deliver 

ed  long  after  events  have  taken  place.    The  result  has  been  that 
evaluation  has  failed  to  serve  the  primary  purpose  of  aiding  local 
projects  in  improving  their  efficiency  and  effectiveness.  What 
can  be  learned  from  the  past  history  of  evaluation  is  that  a 

model  which  cannot  be  demonstrated  to  be  a  useful  tool  to  local 
administrators  must  fail. 

In  response  to  these  complexities  Bokonon  Systems  has  proposed 
a  solution.    While  the  States  have  indicated  wide  variation  in 
their  EPSDT  activities,  one  simple  fact  remains:    Regardless  of 
the  structure  of  State  EPSDT  implementation,  early,  and  periodic 
screening,  diagnosis  and  treatment  must  be  delivered  to  an 
eligible  population  in  each  State.    Accordingly,  there  should  be 
substantive  commonalities  among  States  with  respect  to  what  they 
are  doing,  probably  offseting  the  weighty  differences  which 
exist. 

This  position  gave  rise  to  the  notion  of  utilizing  a  data 
classification  system  to  evaluate  a  wide  range  of  EPSDT  activities. 
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By  classification  system,  we  mean  the  ordering  of  data  describing 
similar  events  into  categories  by  functional  activities.    Such  a 
system  is  based  on  the  determination  of  data  that  various  States 
are  presently  collecting  and  the  organization  of  these  data  through 
analysis  packages  into  a  common  output  necessary  for  Federal 
requirements . 

The  data  classification  system  approach  accommodates  reporting  and 
analysis  problems  within  States  as  well  as  the  problems  of  State 
to  Federal  reporting.    Furthermore,  States  which  operate  EPSDT  on 
a  decentralized  local  project  basis  will  likely  find  differences 
in  local  information  systems,  hence  this  approach  may  serve  as  a 
model  for  their  efforts  as  well . 

In  carrying  out  this  effort  Bokonon  Systems  has  prepared  the 
following  reports: 

Literature  Analysis,:  a  review  of  pediatric  health  care  delivery 


EPSDT  Status  Report:  an  in-depth  review  of  on-going  activities 


and  case  management  efforts  with  respect 


to  their  implications  for  EPSDT. 


in  eight  states  and  one  urban  area. 


Particular  reference  is  made  to  adminis- 
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trative  data  systems  and  use  of  data  for 


evaluation  and  planning. 


Federal  Policy  Options:  an  examination  of  EPSDT  Federal  policy 


The  efforts  which  were  undertaken  in  the  course  of  this 
contract  were  carried  out  to  determine  the  issues  which  would 
affect  the  evaluation  of  EPSDT.    This  paper  considers  the  issues 
at  the  State  and  local  level  and  is  the  final  one  in  the  series. 
Subsequently,  efforts  will  be  directed  to  the  development  of  an 
evaluation  model  which  has  the  ability  to  confront  State  and 
local  issues  while  concurrently  serving  needs  at  the  Federal 
level . 


options  and  their  implications  for  evalua 


tion. 
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3.0   STATE  AND  LOCAL  ISSUES 

EPSDT  has  been  implemented  in  a  wide  variety  of  ways  throughout 
the  States.    While  each  State  may  have  undertaken  an  independent 
effort,  certain  natural  groupings  appear  to  have  resulted,  These 
groupings  may  be  categorized  under  the  headings  of  early  screening 
and  diagnosis  and  treatment  (ES-DT)  and  EPSDT. 

In  those  States  which  are  categorized  by  the  ES-DT  distinction  the 
primary  concern  is  to  meet  Federal  compliance  requirements  for 
screening.    In  these  States  diagnosis  and  treatment  are  offered 
under  normal  Title  XIX  procedures.    States  which  are  categorized  by 
an  EPSDT  strategy  are  attempting  to  provide  a  cohesive  and  organized 
service  delivery  program. 

The  data  files  in  the  States  reflect  these  categorical  divisions. 
In  those  States  where  early  screening  is  of  primary  concern  two 
major  sets  of  data  files  usually  exist  (e.g.  [1]  screening  file, 
[2]  diagnosis  and  treatment  file;  and  in  some  States  where  fiscal 
agents  are  functioning  additional  payment  files  may  exist).  In 
those  States  where  EPSDT  is  the  thrust  a  unified  data  system 
which  may  permit  tracking  and  queuing  of  clients  is  in  operation. 
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Th  e  distinctions  between  State  and  local  project  efforts  in  EPSDT 
are  not  clear.  State  programs  which  utilize  primary  solo  practi- 
tioners are  organized  as  though  they  were  one  single  project. 

In  these  cases  the  State  is  directly  responsible  for  client  flow, 
identification  of  eligibles,  scheduling  of  screening  appointments, 
scheduling  referrals  and  tracking.    These  activities  are  usually 
performed  through  the  use  of  State-employed  case  workers. 

In  States  where  health  and  welfare  is  a  local  (i.e.,  county  or 
regional),  option,  the  relationship  of  the  State  to  local  projects 
is  similar  to  that  between  Federal  government  and  the  States. 
The  State  is  responsible  for  monitoring  local  administrative 
efforts  in  meeting  compliance.    This  allows  the  State  the 
opportunity  to  examine  differences  among  local  jurisdications , 
determine  successful  modes  of  operation  and  then  promulgate  these 
successes.    It  should  be  noted  that  this  does  not  suggest  that 
the  States  assume  Federal  responsibilities  for  impact  evaluation 
but  that  States  do  have  responsibility  for  ensuring  the  transfer 
of  technology  necessary  to  improve  the  efficiency  and  effective- 
ness of  local  jurisdictions  in  meeting  compliance. 

Evaluation  issue  distinctions  between  State  and  local  projects 
appear  to  be  a  question  of  size  rather  than  activity.    The  problems 
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a  local  project  has  in  servicing  a  single  county  are  similar  to 
those  the  State  has  servicing  all  its  eligibles.    The  critical 
evaluation  issues  remain  those  which  have  to  do  with  improving 
efficiency  and  effectiveness  in  delivering  EPSDT  services.  Con- 
sequently, it  is  hoped  that  the  issues  discussed  in  this  paper 
reflect  the  needs  of  operational  administrators  and  their  staffs 
at  both  the  local  and  State  level. 

This  last  position  does  not  mean  to  ignore  State  policy  preroga- 
tives.   Under  Title  XIX  it  formulates  policy  which  specify  eligi- 
bility and  benefits.    Included  in  these  specifications  is  the 
definition  of  screening,  diagnosis,  and  treatment  packages.  Con- 
sequently, EPSDT  evaluation  can  serve  to  provide  information 
necessary  for  policy  decisions  about  benefit  packages. 

3.1    A  STRUCTURE  FOR  EPSDT 

EPSDT  has  been  realized  in  a  wide  variety  of  ways  across  the  States. 
Activities  in  the  States  have  demonstrated  a  range  of  concern  from  a 
discrete  interest  in  the  number  of  children  screened,  diagnosed 
and  treated  to  a  push  for  the  development  of  comprehensive  health 
services  for  eligible  pediatric  populations. 
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In  an  effort  to  articulate  a  structure  in  which  EPSDT  activities 
may  be  examined,  we  intend  to  describe  the  underlying  concepts  in 
terms  of  a  comprehensive  care  system.    This  will  permit  EPSDT 
activities  to  be  categorized  by  way  of  common  structure  which 
will  permit  the  variation  across  States  to  be  examined  on  the  basis 
of  their  common  elements. 

The  concept  of  comprehensive  health  care  as  promulgated  in  EPSDT 
legislation  has  as  its  underlying  philosophy  the  medical  service 
tradition  prevalent  in  this  country,  namely  acute. epi sodic  treat- 
ment.   The  concept  is  therefore  a  practitioner-oriented  phenomenon 
and  may  be  considered  a  method  for  organizing  practitioners'  time 
to  maximize  utilization  of  services,  by  high  risk  target  popula- 
tions who  are  presumed  not  to  have  access  to  the  "health  delivery 
system. " 

What  this  means  is  that  the  problems  for  the  States  are  those 
associated  with  identifying  eligibles,  defining  screening 
and  treatment  packages,  scheduling  clients,  and  ensuring  the 
availability  and  quality  of  resources. 

Consequently,  EPSDT  activities  which  are  carried  out  to  meet  the 
requirements  of  providing  early  and  periodic  screening,  diagnosis 
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and  treatment  to  eligible  populations  must  be  structured  so  that 
an  evaluation  will  permit  the  determination  of  the  ways  in  which 
the  relationships  between  clients  and  services  result  in  more 
children  being  screened,  diagnosed  and  treated  on  a  regular  basis. 
Subsequently,  evaluative  questions  which  deal  with  the  impact 
of  these  services  upon  child  health  status  must  be  considered. 

We  have  developed  a  hypothetical  structure  of  an  EPSDT 
delivery  system  which  will  allow  for  the  consideration  of 
findings  within  specific  activity  categories.    Figure  1  is 
a  graphic  display  of  the  structural  elements  in  EPSDT.  These 
elements  may  be  described  as  follows: 
PENETRATION 

Under  penetration  are  included  activities  which 
identify  clients  and  their  needs  and  result  in  their 
arriving  to  obtain  an  appropriate  screen.    A  large 
number  of  activities  are  subsumed  under  penetration. 
These  include: 

1)  Eligibility  determination 

2)  Identifying  those  receiving  equivalent  services 

3)  Outreach  activities 

4)  Support  services 

Not  all  of  these  activities  are  carried  out  by  each  State 
or  local  EPSDT  project.        ;  . 
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SCREENING 

Within  this  subcomponent  concerns  are  related  to  the 
efficacy  and  efficiency  of  screening.    The  activities  under 
examination  have  to  do  with  the  effectiveness  of  the  screening 
packages,  the  availability  and  types  of  personnel  who  perform 
the  screen  and  subsequent  scheduling  and  referral  for 
diagnosis  and  treatment. 

DIAGNOSIS  AND  TREATMENT 

Within  this  element  one  considers  the  activities  which 
define  the  State  treatment  package,  who  provides  the 
services  and  to  whatever  extent  possible  the  quality  of 
these  services.    In  addition  referral  from  diagnosis  to 
treatment  and  maintenance  of  patients  in  treatment 
plans  may  also  be  considered. 

PERIODICITY 

Periodicity  activities  are  similar  to  penetration 
activities  and  require  identification  and  scheduling 
for  rescreening.    As  with  penetration,  the  question  of 
equivalent  services  must  be  considered. 
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It  should  be  noted  that  case  management  is  not  considered  separately. 
The  reason  for  this  is  that  for  the  purposes  of  evaluation  the 
question  of  the  effects  of  case  management  is  determined  by  whether 
or  not  it  is  done  and  where.    Consequently,  case  management  efforts 
which  lead  to  successful  referrals  between  screening,  diagnosis 
and  treatment  are  considered  within  the  activity  category  in  which 
it  occurs.    Partial  justification  for  this  position  is  offered  by 
the  differential  no-show  rates  which  obtain  between  various 
activities. 

3.2    TYPES  OF  ISSUES 

The  concept  of  comprehensive  health  care  promulgated  in  the 
EPSDT  legislation  has  as  its  underlying  philosophy  the  medical 
service  tradition  prevalent  in  this  country,  namely,  acute 
episodic  treatment.    EPSDT' s  definition  as  a  program  of  prevention  is 
embodied  in  the  ideal  of  early  detection  and  raDid  acute  treatment. 
The  question  of  whether  or  not  this  is  a  successful  method  for  meeting 
the  needs  of  eligible  pediatric  populations  is  a  Federal  responsibility 
The  role  of  the  State  in  EPSDT  is  to  carry  out  the  legislative 
mandate.    Consequently,  EPSDT  activities  are  carried  out  at  State 
and  local  levels  to  meet  the  requirements  of  providing  early  and 
periodic  screening,  diagnosis  and  treatment  to  eligible  populations. 
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The  role  of  evaluation  is  to  aid  State  and  local  administrators 
in  determining  the  ways  in  which  the  relationships  between  clients 
and  services  result  in  more  children  being  screened,  diagnosed  and 
treated  on  a  regular  basis. 

At  present,  EPSDT. State  and  local  administrators  are  concerned 
with  issues  which  fall  into  two  basic  categories,  compliance  and 
planning.    Compliance  issues  are  mandated  by  the  legislation  and 
focus  on  program  implementation  activities.    At  present  because 
of  Federal  and  legal  pressures  compliance  has  had  an  unwarranted 
prominence.    In  EPSDT  compliance  requires  that  specific  activities 
be  undertaken  in  a  financially  accountable  manner.    These  compliance 
issues  resolve  themselves  around  a  count  of  service  activities  being 
undertaken.    These  counts  are  obtained  from  information  systems  which 
monitor  the  presence  or  absence  of  particular  activities. 

Planning  issues  permit  a  program  administrator  to  focus  on  methods 
and  procedures  which  increase  program  effectiveness  and  program 
efficiency.    These  are  complementary  concerns  since  the  realization 
of  EPSDT  objectives  must  be  accomplished  at  a  cost  commensurate  with 
its  benefits.    Planning  issues  are  resolved  through  information 
provided  by  evaluation  systems.     Evaluation  is  the  examination  and 
analysis  of  activities  which  permit  program  functions  to  be  examined 
in  depth  and  in  terms  of  their  effectiveness  in  achieving  program 
objectives. 


-22- 


3.2.1    COMPLIANCE  ISSUES 

Legislation  has  defined  the  activities  which  each  State  program 
must  perform.    Subsequently,  Social  and  Rehabilitation  Services  has 
defined  these  in  the  following  ways  (MSA,  PRG,  21): 

1)  Have  all  eligibles  been  directly  notified  of  availability 
of  screening  services;  does  this  happen  at  least  annually? 

2)  Are  screening  services  delivered  to  those  requesting  them 
and  within  a  reasonable  time  from  the  request? 

3)  Are  abnormalities  detected  in  screening  diagnosed  and  treated 
according  to  the  provisions  of  the  State  Medicaid  Plan 
including  EPSDT  exceptions  for  ear,  eye  and  dental  care? 
Does  this  occur  within  a  reasonable  time  frame? 

4)  Are  periodic  screenings  provided  according  to  State  periodicity 
schedul es? 

The  degree  to  which  a  State  or  project  accomplishes  these 
activities  determines  whether  or  not  it  is  in  compliance.  To 
determine  the  level  of  compliance  a  system  which  provides  counts 
of  on-going  events  must  be  established. 

Performance  indicators  which  provide  a  measure  of  EPSDT  activities 
fall  into  the  following  categories: 
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total  eligible  population 
target  sub-population 
number  of  appointments 

number  screened  - 
full  screen,  partial  screen 
total  completed  full  screen 

no-shows 

screening  results,  i.e.  number  of 
well  children,  number  with  detected 
abnormalities  -  single/multiple 
abnormal i ties 

number  of  children  referred  for 
diagnosis  and  treatment 

number  appearing  for  diagnosis  and 

treatment 
number  of  no-shows 
number  of  children  treated  - 

single  abnormality,  multiple 

abnormality,  number  identified 

as  well  children 

number  of  children  rescreened 


These  activity  counts  provide  a  preliminary  picture  of  the  degree 
to  which  a  local  project  or  a  State  is  in  compliance.    However,  a 
more  detailed  examination  requires  that  these  activities  be 
considered  in  terms  of  available  resources  and  equivalent 
services  presently  utilized  by  the  eligible  population. 


Subsequently,  the  following  compliance  issues  may  be  addressed: 

1)  Assessment  of  compliance  for  each  jurisdiction  (local 
project,  region,  State)  by  sub-system 

2)  Identification  of  sub-system  failures 


Penetration 


Screening 


Treatment 


Periodicity 
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3)  Indication  of  failure  by: 

a)  lack  of  available  resources 

b)  no  action 

4)  Determination  of  program  ability  to  obtain  compliance  based 
on  availability  of  resources  and  activities  to  be  performed. 

The  discussion  of  compliance  issues  and  their  measurement 
points  out  the  possibilities  of  maintaining  an  updated  overview  of 
EPSDT  efforts.    If  the  systems  which  can  provide  this  information 
are  established,  then  providing  data  which  defines  the  degree  to 
which  compliance  has  been  obtained  is  a  reasonable  expectation. 
However,  monitoring  systems  which  serve  only  to  respond  to  outside 
pressures  (e.g.  Federal  legislation  which  requires  compliance)  do 
not  make  full  use  of  program  monitoring.    The  maintenance  of  a 
monitoring  system  which  is  up-to-date  and  reliable  can  provide  local 
administrators  with  an  indication  of  the  status  of  their  program. 
System  failures  identified  through  program  monitoring  can 
serve  to  specify  the  need  for  more  in-depth  examination  of 
project  activities  through  the  use  of  program  evaluation. 

EPSDT  is  mandated  under  Title  XIX  and  as  such  is  a  captive  of 
the  Medicaid  environment.    Medicaid  requires  the  presence  of 
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certain  fiscal  accountability  and  quality  control  procedures. 
These  concern  eligibility  determination,  utilization  controls 
and  fraud  detection.    These  requirements  are  also  applied 
to  EPSDT  and  the  problems  associated  with  these  procedures  which 
are  found  in  Medicaid  are  the  same  for  EPSDT.    It  is  expected 
that  State  and  local  projects  do  have  quality  control  and  fiscal 
accountability  methods  as  required  by  their  State  Medicaid  Plans. 
The  appropriateness  or  effectiveness  of  these  methods  are  not 
addressed  by  EPSDT  evaluation  methods  except  insofar  as  they  may 
relate  to  specific  evaluation  issues. 

3.2.2    PLANNING  ISSUES 

Planning  is  all  too  frequently  conceived  of  as  the  development  of 
a  long-term  strategy  for  obtaining  program  goals.    It  is  also  a 
necessary  method  to  effectively  meet  day-to-day  project  requirements. 
The  critical  aspect  of  all  planning  functions  is  evaluation:  the 
ability  to  assess  a  project's  efficiency  and  effectiveness  on  an 
ongoing  basis.    Therefore,  the  central  issues  in  planning  are  those 
which  deal  with  the  evaluation  of  project  efficiency  and  effectiveness 

There  exists  a  sharp  distinction  in  Federally  supported  programs 
between  Federal  and  State/local  evaluation  issues.    At  the  Federal 
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level,  program  impact  is  a  primary  concern.    In  the  case  of  EPSDT, 
the  major  impact  question  is  whether  or  not  the  comprehensive  health 
strategy  mandated  in  the  legislation  results  in  significant  changes 
in  children. 

State  and  local  evaluation  issues  in  Federally  supported  programs 
are  those  concerned  with  the  attainment  of  efficiency  and  effectiveness 
in  legislatively  mandated  activities.    In  the  case  of  EPSDT,  State 
and  local  administrators  must  have  performance  indicators  which 
demonstrate  the  degree  to  which  EPSDT  activities  have  efficiently  and 
effectively  delivered  the  mandated  services.    Consequently,  health 
planners  can  ascertain  program  failures  and  successes.    This  information 
can  lead  to  a  re-allocation  of  resources  and  changes  in  the  makeup  of 
screening  and  treatment  packages  which  may  result  in  improved  EPSDT 
activities. 

That  there  is  a  distinction  between  Federal  and  State/local  focus  in 
evaluation  is  clear;  however,  it  is  important  to  recognize  that  the 
data  used  for  evaluation  purposes  is  the  same.    The  differences  rest 
upon  the  focus  of  the  questions  with  which  one  addresses  the  data. 
For  example,  let  us  consider  data  which  describes  pediatric 
morbidity  patterns.    At  the  Federal  level  examination  of  childhood 
morbidity  data  may  indicate  that  the  EPSDT  comprehensive  health 
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care. strategy  does  not  result  in  reducing  the  incidence  and  prevalence 
of  pediatric  diseases.    At  the  local  level  examination  of  the  same 
morbidity  distributions  by  socio-demographic  variables  such  as 
age,  sex,  and  geographic  location  can  aid  the  planner  in  identifying 
high  risk  target  populations  and  in  reorganizing  his  service  delivery 
capabilities  to  meet  the  expected  morbidity  demand. 

Parenthetically,  it  should  be  noted  that  in  this  paper  the  terms 
efficiency  and  effectiveness  are  used  in  a  specific  sense.  Efficiency 
is  an  imput  measurement  and  is  defined  in  terms  of  unit  cost  or  unit 
of  work  (e.g.  which  of  two  screening  tests  is  cheaper  or  takes  less 
time  to  administer?)    Effectiveness  as  used  in  this  discussion  is  a 
client  referenced  measure  and  is  defined  in  terms  of  the  degree  to 
which  EPSDT  activities  in  any  subcomponent  provides  services  to  how 
many  children. 

if 

It  is  entirely  possible  to  have  an  efficient  yet  ineffective  program. 
For  example,  a  screening  clinic  may  have  the  most  efficient  combination 
of  tests  and  personnel  but  operate  at  hours  which  are  detrimental  to 
local  recipients'  needs.    Consequently,  this  efficient  center  is 
operating  in  an  ineffective  manner. 

Planning  in  EPSDT  requires  knowledge  of  recipients  and  service 
capabilities  and  the  degree  to  which  this  information  is  articulated 
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is  the  degree  to  which  the  planner  can  evaluate  his  program  efforts 
and  make  decisions  which  will  lead  to  efficient  and  effective 
activities.    Consequently,  particular  information  must  be  available. 
These  include  client  data  by  geographic  distribution,  age,  sex  and 
service  data  by  geographic  distribution  and  type. 

Subsequently,  an  EPSDT  administrator  may  consider  the  results  of 
penetration,  screening,  diagnosis  and  treatment  subcomponents  within 
the  framework  of  his  clientele  and  service  capabilities  in  dealing 
with  the  focal  issues  of  EPSDT. 

Our  own  past  experience  in  State  and  local  areas  suggest  that  this 
information  exists.    In  some  States  it  is  already  part  of  an 
automated  data  system  while  in  others  it  appears  in  hard  copy  which 
may  become  readily  accessible  for  inclusion  in  EDP  systems.  The 
following  discussion  presents  State/local  issues. 


EPSDT  legislation  requires  identification  and  aggressive  recruitment 
of  eligibles.    The  issues  in  penetration  have  to  do  with  eligibility, 
outreach  methods  and  equivalent  services. 


PENETRATION 
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Eligibility:    Eligibility  is  a  State  policy.    The  question  of 
errors  in  eligibility  determination  (i.e.  declaring  an  ineligible 
child  eligible  or  failing  to  provide  eligibility  status  to  a 
child  meeting  requirements)  is  a  State  problem  which  has  to  do 
with  the  quality  of  the  States'  welfare  efforts.    It  cannot  be 
expected  that  EPSDT  evaluation  efforts  address  this  problem.  However, 
the  question  of  turnover  forces  EPSDT  administrators  to  ensure  that  a 
system  for  updating  eligibility  exists  and  that  updated  lists  of 
eligibles  are  available  to  vendors  of  screening,  diagnosis  and 
treatment.    Turnover  in  el i gi biles    has  implications  throughout 
the  entire  system  because  the  turnover  may  be  reflected  in  "no  shows" 
at  each  service  subcomponent. 

Outreach:    Outreach  methods  are  used  to  elicit  client  entry  into 
EPSDT.    These  vary  considerably  as  they  range  from  annual  mailings  of 
flyers  to  the  employment  of  special  health  para-professional  outreach 
workers.    The  question  of  both  the  efficiency  and  effectiveness  of 
these  methods  must  be'addressed  by  the  States  at  the  local  level  since  / 
some  methods  may  be  more  successful  than  others  in  attracting  particular 
populations. 

Included  under  outreach  activities  are  those  issues  which  center 
around  the  problem   of  support  services  such  as  transporation  [which 
is  mandated]  and  other  alternatives  .offered  through  State  and  local 
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jurisdictions.  Whether  or  not  these  are  available  and  provided 
on  a  timely  basis  can  be  an  issue  for  the  EPSDT  administrator. 


Equivalent  Services:    Preliminary  studies  have  suggested  that 
recipients  who  may  be  eligible  for  EPSDT  view  the  program  either 
with  apprehension  or  feel  that  it  is  unnecessary  because  they  are 
already  under  care  which  they  view  as  appropriate.    The  issue 
of  quality  of  EPSDT  efforts  is  discussed  under  Screening  and 
Diagnosis  and  Treatment.    However,  the  question  of  equivalent  care 
is  an  important  one.    The  issues  here  are  how  to  identify  equivalent 
care  and  how  to  ensure  sufficient  control  of  equivalent  care  so  that 
clients  remain  within  an  equivalent  care  system.     These  are  extremely 
important  for  if  equivalent  care  services  are  not  incorporated  into 
EPSDT  and  the  same  quality  control  mechanisms  applied,  then  there  is 
no  assurance  that  these  equivalent  care  systems  will  maintain  their 


The  central  issue  in  this  subcomponent  focuses  upon  selection  of 
screening  tests,  conditions  under  which  screening  is  performed, 
quality  control  and  referral  from  screening  to  diagnosis. 

Screening  Tests:    Selection  of  appropriate  tests  is  critical  since 
there  are  tests  which  indicate  symptoms  for  which  there  is  no  treatment. 


quality. 
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as  well  as  those  which  indicate  trivial  illnesses.    If  these  are 
not  eliminated,  diagnosis  and  treatment  practitioners  may  be 
hesitant  to  participate  in  EPSDT  because  they  feel  they  will  increase 
their  case  load  for  trivial  and/or  non-remedial  health  reasons. 
In  addition,  the  question  of  which  test  to  use  must  be  considered 
in  terms  of  efficiency. 

Screening  Conditions:    Under  screening  conditions  are  included  issues 
which  have  to  do  with  schedule  of  screening  services  (i.e.  are  they 
sufficient  and  available  at  times  appropriate  to  the  recipient 
clientele?  Who  performs  the  screen?  Can  screening  be  performed  at 
a  single  visit  or  are  multiple  visits  and/or  multiple  sites  needed 
to  complete  a  screen?) 

Finally,  the  question  of  who  performs  a  screen  is  particularly 
important  in  terms  of  providing  efficient  services.    This  issue 
addresses  the  use  of  personnel  other  than  practitioners  in  performing 
screening  services. 

Qual i ty  Control :    Quality  control  in  screening  is  a  critical  factor. 
Poor  quality  can  result  in  high  incidence  of  both  false  positives  and 
false  negatives.    High  incidence  of  false  negatives  will  result  in 
client  antipathy  toward  EPSDT.    High  incidence  of  false  positives 
will  create  difficulties  among  diagnosis  and  treatment  vendors  whose 
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case  loads  will  be  increased  for  inappropriate  reasons. 

Referral :    The  issues  under  referral  are  those  related  to  conditions 
which  result  in  "no  shows"  between  screening  and  diagnosis.  Vendor 
accessibility  and  other  causes  of  long  delays  in  scheduling  must  be 
considered. 


The  issues  in  diagnosis  and  treatment  focus  upon  provider  parti- 
cipation, quality  of  care,  and  treatment,  maintenance .    In  addition, 
there  is  a  general  problem  which  results  from  the  artificial  dis- 
tinction among  screening,  diagnosis  and  treatment.    This  issue 
results  from  the  fact  that  many  pediatric  diseases  may  be  diagnosed 
and  treated  at  the  same  time  as  screening.    In  addition,  immuniza- 
tion may  also  be  offered  during  screening.    Requiring  a  separation 
in  screening,  diagnosis  and  treatment  substantially  increases  cost. 
The  problem  is  further  compounded  by  the  fact  that  certain  States 
have  legal  restrictions  which  do  not  permit  screening  services  to 


offer  diagnosis  and  treatment.    In  addition,  legal  and  Federal 
pressures  to  implement  EPSDT  have  emphasized  screening.  This 
emphasis  has  not  always  been  accompanied  by  similar  concern  with 
diagnosis  and"  treatment.    Consequently,  some  States  show  high  screening 
rates  and  low  follow-up  of  referrals  to  diagnosis  and  treatment. 


DIAGNOSIS  AND  TREATMENT 
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Provider  Participation:    The  issues  in  provider  participation  are 
availability  and  participation.    The  question  of  availability  is 
an  important  one  for  States  with  rural  populations  because  many 
suffer  from  dire  shortages  of  practitioners. 

The  issue  of  practitioner  participation  is  a  critical  issue  parti- 
cularly in  those  States  which  require  separate  EPSDT  participation 
contracts.    In  these  States  the  problems  of  provider  availability 
are  compounded  by  antipathy  toward  participation  in  EPSDT.  Consequently, 
some  States  may  be  unable  to  fulfill  the  requirements  for  statewide 
provision  of  diagnosis  and  treatment  services. 

Quality  of  Care:    The  question  of  quality  of  care  is  addressed  in  the 
States  through  Medicaid  provisions  for  Utilization  Review  and  PSRO. 
A  more  sophisticated  effort  was  encountered  in  one  State    which  uses 
a  mobile  van  to  select  samples  of  children  who  receive  dental  care 
and  check  for  fraudulent  billing  as  well  as  quality  work.    The  question 


of  quality  of  care  may  be  further  addressed  in  EPSDT  insofar  as  com- 
parisons may  be  made  by  utilization  and  outcome  among  particular  pro- 
viders. 

Treatment  Maintenance:    The  issues  of  a  case  management  system  for 
treatment  maintenance  must  be  considered.    In  some  States  a  complete 
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treatment  plan  is  provided  for  approval  and  forwarded  to  the  case 
management  worker  with  the  responsibility  for  ensuring  that  the 
client  is  scheduled  and  appears  for  treatment  follow-up.    In  many 
States  these  efforts  are  not  offered  and  consequently  treatment 
follow-up  has  not  been  achieved. 

The  issues  in  EPSDT  are  those  concerned  with  the  delivery  of  com- 
prehensive health  care  services  to  eligible  pediatric  populations. 

Articulation  of  these  issues  should  lead  to  the  determination  of 
those  service  behaviors  which  need  to  be  measured  in  order  to  make 
decisions  which  lead  to  improved  service  delivery. 

This  paper  has  been  prepared  for  presentation  to  a  representative 
group  of  state  and  local  persons  who  are  concerned  with  the  delivery 
of  EPSDT  services.    It  is  expected  that  the  participants  will  aid 
in  the  refinement  of  these  issues.    This  will  set  the  stage  for  the 
development  of  an  evaluation  model  for  use  at  State  and  local  levels. 
Concurrent  with  this  effort,  SRS  policy  concerns  will  be  examined  and 
the  relationship  among  State  and  local  and  Federal  evaluation  needs 
determined.    Finally,  a  classification  system  which  defines  data  by 
types,  and  demonstrates  the  relationship  between  their  collection  and 
use  at  the  local  levels  and  indicates  their  ability  to  service  Federal 
policy  needs  will  be  presented. 
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